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(54) Apparatus for assisting steering of vehicle when backing 

(57) A steering assist apparatus (10) that assists a 
driver when backing a vehicle (1) in an S-shaped path or 
parallel parking. The apparatus displays guidance 
marking (17) on a nnonrtor screen (19) and the driver 
relers to the guidance marking, which permits the driver 
to easily back the vehicle to a desired position. The 
apparatus includes a camera (2). a monitor (4), an 
angle sensor (9), obstacle sensors (6), an image 
processing unit (11). a controller (12) and a monitor 
controller (13). The image processing unit computes the 
predicted path of the vehicle at the current wheel angle. 
The monitor shows an image captured by the camera. 
The Image processing unit generates data representing 
a guidance marking based on the predicted path and 
superirrposes the marking on the monitor screen. The 
location o1 the marking on the screen is determined 
based on the current wheel angle. The marking repre- 
sents part of the predicted path. Specif ically, the mark- 
ing matches the width o1 the vehicle. In the monitor 
screen, a marking Is separated from the rear bumper of 
the vehicle by a distance corresponding to the wheel- 
base of the vehicle. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates to an apparatus for assisting steering when a vehicle is moving backward. 
More specifically, the present invention relates to a steering assist apparatus that includes a camera for capturing the 
view from the rear and a monitor for displaying the captured view along with marking for assisting the driver. 
[0002] In the prior art, apparatuses for showing the view from the rear of a vehicle have been proposed. Such an 
apparatus allows the driver to see the view from the vehicle rear without actually turning around. Japanese Examined 
Patent Publication No. 2-36417 discloses a rear monitoring apparatus, which includes a video camera tor capturing 
view from the rear of the vehicle, a video monitor for showing the captured view and a sensor for outputting signals rep- 
resenting the angle of vehicle wheels. The apparatus generates marker signals based on signals from the wheel angle 
sensor and superimposes a marker on the video monitor. The positions of the markers on the monitor correspond to 
the direction in which the vehicle is being backed. The direction is determined in accordance with the steered angle of 
the vehicle wheels. The apparatus includes a read only memory (ROM), which stores steered angle data of the vehicle 
wheels and marker position data. When the vehicle is moving backward, the course of the vehicle is predicted based 
on the steered angle data. The predicted course is displayed by rows of the markers superimposed on the monitor 
screen showing the image captured by the video camera. 

[0003] Japanese Unexamined Patent Publication No. 1 0-1 75482 discloses an apparatus for assisting the view from 
the rear of a vehicle. This apparatus includes a detector for detecting the angle of the front wheels, a vehicle speed sen- 
sor, a camera for capturing the view from the rear of the vehicle and monitor for displaying the view. The apparatus also 
includes a computer. When the vehicle is moving backward, the computer computes the path of the rear wheels based 
on the steered angle of the front wheels. The predicted path is converted into path image data, which represents the 
predicted path as viewed from the rear camera. The path image data is further converted into linear marking data, 
which corresponds to the nnonttor screen. The linear marking data is superimposed on the image of the view from the 
vehicle rear shown on the monitor screen. 

[0004] Japanese Unexamined Patent Piislication No. 10-244891 discloses a parking assist apparatus. This appa- 
ratus includes first and second image pickup means provided at the sides of the vehicle to capture the image of the 
vehicle surroundings. The apparatus superimposes lines on the image captured by the image pickup means. The lines 
permit the driver to judge whether parallel parking is possible. 

[0005] The apparatuses of the publications No. 2-36417 and No. 10-175482 both show the rear view captured bya 
camera and predict the path of the vehicle or the path of the rear wheels based on the current wheel angle. The appa- 
ratuses then superimpose the predicted path on the monitor screen. The superimposed path does not correspond to 
the vehicle length or the wheeibase. When passing another car in a winding road such as a mountain road, the driver 
may have to move his vehicle backward until the vehicle reaches a spot that is wide enough for two vehicles to pass 
each other. At this time, the apparatuses of the publications No. 2-36417 and No. 10-175432 will show the view from 
the rear and the predicted path on a monitor. Accordingly, the driver will know whether maintaining the angle of the front 
wheels will cause the vehicle to leave the road. 

[0006] However, as shown in Fig. 26, all the currently predicted data of a path 41 representing the vehicle path or 
the predicted rear wheel path is shown on a monitor screen 42. Thus, if the curvature of the road 43 is not constant for 
a relatively long distance and the wheel angle does not correspond to the curvature of the road 43, the upper end of the 
superimposed path 41 does not match the road 43 on the screen 42. Generally, the cun^ture of a road is not constant 
for a long distance on winding roads such as mountain roads. Therefore, the superimposed path 41 is often partly off 
of the a road on the saeen 42. which at least permits the driver to realize that maintaining the cunent wheel angle will 
cause the vehicle to leave the road. However, the superimposed path 41 does not give the driver information necessary 
for judging how he should manipulate the steering wheel. In other words, the superimposed path 41 cannot be used for 
determining the steering amount of the steering wheel. 

[0007] When parallel parking a vehicle, the driver has to switch the direction of steering. However, the superim- 
posed path 41 does not help the driver to judge when to switch the steering direction. 

[0008] The apparatus of the publication No. 10-244891 assists the driver when parking a vehicle. The apparatus 
needs two image pickup means to capture front and rear images from the vehicle side. The apparatus shows a line for 
indicating whether parallel parking is possible. The computation of the line is complicated: 

SUMMARY OF THE INVENTION 

[0009] Accordingly, it is an objective of the present invention to provide an apparatus for assisting ste 

when vehicle is moving backward, which provides guidance on a monitor screen for permitting a driver to easily move 

the vehicle to a desired position when the driver moves the vehicle backward along an S-shaped corner or when the 
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driver oarallel parks the vehicle. . . ^. 

tool 01 TO achieve the foregoing and other objective and in accordance with the purpose ot the present .iwent.or,. 
Ln aSaratus foraiding steering when a vehicle is being driven in reverse is provided. The moving direction of the vehi- 
an apparatus Toraiai y „i eiooroH «,hopi« thp aooaratus includes_a_camera for capturing an 

Trt for displi?^ a guide marking for aiding steering. The marking and the Image are s-mu Uanwusly cl'splay«J on tt^e 
Tnn tor When S vehicle is being driven in reverse. The marMng provides a driver with at least f.rst .nd.cat.on of tt^e 
Tdrof The vehicle arid a second indication of a prospective path of the vehicle corresporxJ-ng to the posrtion of the 

,n mmif '"^'Se present invention may be another apparatus for aiding steering when a vehicle is b«ng driven In 
^JlrseThrr^oSidiredionofthevehicleisdeterminedlnresp^^^ 

Sesrcamera for capturing an image of an area behind the vehicle, a monitor for displaymg the .mage cap ured ^ 
hefameraTrS a display control unit for displaying a guide marking that is fixed at a predetermined posrtion with 
eLeXthe monitor saeen for aiding a driver in parking. The control unrt displays the gu.de mark.nfl and the .mage 
,s JSt^usly on the monitor when the vehicle moves in reverse. The parallel parking .s completed by caus.ng the 
mTrig to cofnSde with a target point in the Image, followed by backing while keeping the steered wheels turned at 

th«r maximum angle^ and advantages of the invention will become apparent from the following desaiption. taken in 
conjunction with the accompanying drawings. Illustrating by way of example the principles of the .nvention. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

1001 31 The invention, together with marking and advantages thereof, may best be understood by reference to the 
Stowing deirlption of the presently preferred embodiments together with the accompanyng drawings .n which: 

Fig. 1 is a block diagram showing a steering assist apparatus according to a first embodiment; 

Fig. 2 is a schematk: sWe view showing a veWcle having the apparatus of Rg. 1 ; 

Fig. 3 is a schematic view showing the screen of a monrtor; 

Fig. 4 is a flowchart showing a routine for generating data for guidance marking shown on the monitor screen; 

Fig. 5 is a schematic view showing the relationship between the wheel angle and the turn radius ot vehicle wrheels; 

Fig. 6 is a diagram showing the relationship between polar coordinates and an ellipse; 

Fig. 7 Is a diagram showing a vehicle when the vehicle Is moving backward in an S-shaped road; 

40 Fig. 8 is a diagram showing a state of the monitor screen conesponding to the state A of Fig. 7; 

Fig. 9A is a diagram showing a state of the monHor screen conesponding to the state B of Fig. 7; 

Fig. 9B is a diagram showing a stale of the monHor screen when lateral lines of a guide frame are parallel to the 
4S lower sides of the monitor; 

Figs. 10A. 10B and IOC are diagrams showing the positions of a vehicle and the corresponding guidance marWng 
on the monitor screen when the vehicle is being parallel parked; 

Figs. 1 1 A. 1 1 B and 1 1 C are diagrams showing the positions of vehicle and the corresponding guidance marWng 
on the monitor screen when the vehicle is parallel parked: 

Figs. 12A. 12B. 12C and 120 are diagrams showing the monitor screen when parking the vehicle perpendicular to 
a reference such as a curb; 
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Fig. 13 is diagram for calculating the location of a marker on the monitor screenj 
Fig. 14 is a flowchart showing a routine according to a second embodiment; 
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Fig. 15 is a graph showing changes of the angle of wheels when the vehicle is moving along a corner: 
Fig. 1 6 is a diagram showing the paths taken by wheels of a vehicle when the vehicle is moving along a corner; 
! Fig. 1 7 is a diagram showing the relationship between the state of a steering wheel and the path of the vehicle: 

Fig. 18 is a flowchart showing a routine according to a third embodiment; 

Fig. 19 is a diagram for calculating the location of ainarker on the monitor screen according to a fourth embodi- 
10 ment; 

Figs. 20A. 20B and 20C are diagram showing operations of guidance marking on a monitor screen when parallel 
parking a vehicle; 

15 Fig. 21 is a diagram showing a monitor screen showing markers according to a f ifth embodiment; 
Fig. 22 is a diagram for calculating the location of markers on the monrtor screen; 

Fig. 23A is a diagram for calculating the location of a marker on the monHor saeen according to a sixth embodi- 
so ment: 

Fig. 23B Is a diagram for calculating the location of a marker on the monitor screen when the target point is different 
from that ol Fig. 23A; 

25 Figs. 24A and 24B are diagrams showing the locations of markers on a monitor screen; 

Fig. 2SA and 258 are diagrams shovwng the locations of a marker on a monitor screen according to another 
embodiment; and 

so Rg. 26 is a diagram showing a monitor screen of a prior art steering assist apparatus. 
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

rOD141 A first embodiment according to a first embodiment of the present invention will now be described with ref- 
Lr^nS to RQS to ibAs shown in Fig. 2. a vehicle 1 has a monochrome camera 2 for capturing the v,ew from the 
3e ILT A real^umper 3 is at the nearest end 

the farthest extend of the camera view is greater than the length of the vehicle 1 . ^ 
rSol a A mrtoV4 for showing the image captured by the camera 2 is located m 

leh de 1 Thrmonitor 4 is a color liquid crystal display and is also used as the monitor of a navigation system. The 
liSSor 4 is noILly used as the navigation system monitor. When a shift lever 5 is shrfted to a reverse posrt.on. the 

r er ' ^rstrSrsSsS^^^^^ sensors 6. are arranged in the corners of the ve^«.e 1. 

re olstriicSn sensors 6 are for example, conventional sensors such as ultrasonic sensors. When an obstruchon .s 
Ta Jnae bXeen a first distance (for example, about fifty centimeters) and a second distance (tor example, about 
L^S centSSe" ) f?om one of the sensors 6. the sensor 6 outputs a f irst obstruction signal. If the obstruCon is closer 
to the sensor 6 than the second distance, the sensor 6 outputs a second obstrucUon signal, 
loil^ I eeleS wheels, which are front wheels 7a In this embodiment, are steered by manipulating s^eenng means, 
which is a steering wheel 8 in this embodiment. The steered angle a of the front wheels 7a is computed by rnMp^ng 
S^iSi ang e S of the steering wheel 8 by a coefficient K. That is. the angle of the front wheels 7a .s represented by 
50 m -Sie SS angle of the steering wheel 8 is detected by wheel angle detecting means, which is an angle sensor 9 

mi?r"*'STtown in Fig. 1 . a steering assist apparatus 1 0 includes the camera 2. the monitor 4. the angle sensor 9 
tSe obstrucfion sensors 6 a display control means, a controller 12 and a monitor controller 13. The display control 
mL?sTanTmagTp«,ce^sing unH 1 1 in this embodiment. The controller 12 receives signals from the angle sensor 9 
55 Tnd Sriutes tSe aSgle a of the front wheels 7a based on the angle e of the steering wheel 8 and then send the com- 
oSedLZSlto theimageprocessing unit 11 . The monitor controller 13 inputs image signals from the image processor 
' a^d1cS? navlgato%>tem (no-tshow^^ 
monitor 4. 
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,noi91 The image processing unit 11 Includes an arithmetic circuh. or central P'««e^i"9 ^^^Vl ^i' l^Tlr^ 

nrarn Haia stored in the program memory 1 5a. . ^ * j 

foro? ThllpU 14 computes and predicts the backward path of the vehicle 1 f V""' "'^ Lm^ i t"^^^^ 
' L „ h«ed on signals from the controller 12. Superimposed marking in Fig. 3, which is a gu.de frame 17 in this 

i!n« 1^ FiQ 3 Shows the guide frame 17 when the angle a is rero degrees, or when the angle of the front 

?0O24l The marker 21 assists the driver to move the vehicle 1 backward v^en the driver is parWng the ve^ide V 
ETSamoir^TdrhTer matches the marker 21 with a comer of a parking space and then parks the v«h.ctej^'" 
\„n!Tnl Jhv mo^ng the vehicle 1 backward while rotating the steering wheel 8 to the maximum rotation positwn. 

Jomef i shown in Fig. 13. a corner of the vehicle 1 when parked at the dotted line position R dd«ed as a poirrt 
.0 E Th2 dist^e a between the point E and the axis of the rear axle is the rear overhang of the -^h^de V H theste^^^^^ 
LI«r8 is ^ima^ly rotated when the vehicle is moved, the axial center of the rear axle is moved along a arde tt,e 
^- I «• rpc When the tangent of the circle of the radius Rc includes the point E. the axial center of the rear 

S:rs?e«nSasS.ZT^^^^^^ 

oS A line between the center O and the point E is defined as a line OE. The angle defined by the line OCn and the 
line OE is defined as an angle a". TTie following equations are satisfied. 

SE-^(Ro^ + a^) (1) 



coso' = SCn/51 = Rc/7(Ro^ +a^) 
.-. a- = cos'^{Rc / 7(Ro^a)l 

55 Therefore 

CnE = OCn tan a' = Rc tan a' 



(2) 
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DE = Rc tan a '-a 
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ro0281 When the angle defined by the line OE and the line OCn is the angle a', the position of the "rarker 2 on the 
1 o.r^oonds to a point thatis s^arated from the rea, bumper 3 of the vehide 1 by the ^--f^Jl^^J^^^;^ 

l^itheabovVequktions. the length of thelineCnEisavaluethati^^^^^ - - 

rnP is adiusted in consideration of a case where the angle of approach is relatively great. . ^ ^ 
mM91 in Ss embodiment, when the angle a is zero degrees, or when the guide frame 1 7 is at the reference pos.- 
io^^ me lateral iSillyfmatches the lateral line 20b of the fixed frame 20 and the side lines 17b match the s,de hnes 
Saonhe ftSl frame 20- Fig. 3 shows the guide frame 17 at the reference position. To show both frames 17 and 20. 
tho framPB are sliahtlv displaced from each other in Fig. 3. .... 
5o30r ?^e?ogrL r^emory 15a stores display reference data for displaying an obstacle fnder 22 on the. screen 
9 ^e obstecle Ser 22 shows whether any of the sensors 6 is outputting eHher the first or second bbstacle signate^ 
jte^bstecll fTnde^ 22 includes a frame 22a representing the shape of the vehicle 1 and corner markers 23a to 23d 

;oS3?r'"?h?c?J^^^^^^^^^^ the guide frame 17. the fixed frame 20 and the marker 21 to the mon- 

itor controller 13 via the output interlace. The monitor controller superimposes the frames 17. 20 and the marker 21 on 
he irSSoe of the cSrnera 2. The CPU 14 also sends data representing the obstacle finder 22 to the monrtor controHer 
13 ^ In. or cTrTroller 13 displays the view of the camera 2. and images of the guide frame I?, the fixed frame 20. 
the markrai ttie obstacle finder 22 on the monitor 4. The obstacle finder 22 does not interfere wrth the guide 

^ "Snce'thelamIJa l?s a monochrome camera, the image is in black and white. The data for the guide frame 
7 S fixed frame 20. the marker 21 and the obstacle finder 22 are color. Thus, the guide frame 17. the fixed frame 20. 
the n^rke72 1 and the obstacle finder 22 are superimposed in color on the black and white image shown on ttie screen 

igcThemor^it^MT^ewl^^ 

21 S rholTn S^e same color as the color of the ^^^^ 

the S ame 20 at portions between the aoss lines 17c and 17d. In this embodiment, the gu.de frame 17 « 9reen 
iiept toTthe portions between the cross lines 17c 17d. The segments between the cross lines 17c and 17d. the 
markpr 21 and the fixed frame 20 are shown in yellow. 

H none o, the obstacle sensors 6 outputs obstacle signals, the CPU 14 displays the corner rnarkers 23a to 
ihich reorient the sensors 6. by outputting obstacle checking data to the monitor controller 13 and all the comer 
^rk^s 23a to?^ have the same appearance. When receiving the first or second obstacle signal from one or more 
T,he sensore 6 the CPU 14 outputs corresponding obstacle checking data to the monitor controller 13. Aaording^r. 
1 corner marte clrrespo^ the sensor 6 sending the first or second obstacle signal is d.st,r«u.shed from the 
o^ er cCrnJT markers on ttie screen 19. For example, a comer marker is displayed in orange when «i.e corresponding 
^nso? 6 Sp^ a first obstacle signal and the comer marker is displayed in red when the corresponding sensor 6 out- 

C4V''°-Se^ K 'irSutes .he predicted path of the sides of the vehicle when the vehicle 1 Is moved backward 
SHe frorrt^eels 7a steered by the angle a. The predicted path is expressed in polar ~°'^''^*«J?f ^^'f^^ 
Tathfe substantially circular. The lateral line 17a of the frame 17 is drawn between poirrts in the predicted paths o the 
St Of tt Sc^ ^he points are on the sam^ 

S burnper 3 «^^stantially by the length of the wheelbase. The side lines 17b match the pred.cledpath from the ends 
S the EflJie 1 7a to the sides of the bumper 3. The CPU 14 compresses the image of the predicted path c^de In 
Sec^rSriSe vehicle's movement byapredeterminedratia That is. the 

oath irfto a^ elipse as shown in F.g 6. Part of the ellipse corresponding to the size of the guide frame 7 '6 converted 
S J pe^JeS view and is superinposed on the monitor screen 19 as the guide frame 17. The location of the guide 
frame 17 on the saeen 19 is slightly displaced rearward from its accurate position. 

rOD351 The operation of the steering assist apparatus 10 will now be described. . . ^. . . 

0D36 Whenthe shift lever 5 is in the reverse position, the reverse switch 18 sends a signal indicating that the l«rer 
5 is in the reverse position to the CPU 14. In this state, the CPU 14 executes the routine of theflowchart shown in Fig. 
4 at Dredeterminedinten^als (for example, thirty-three milHseconds) for generating data representing the SU'de frame 
SisilallTst« sV the CPU 14 reads the data of the steered angle a from the controller 12. At step S2. the CPU 14 
comoutes the predicted path of the sides of the vehide 1 while assuming that the angle a will not be changed 

Se vSI and the wheelbase of the vehide 1 are defined as W and L. respectively. The distance between 
the radial centers of the rear wheels 7b is defined as Tr. The distance between the center of the turn and the axial center 
of thT eaJSe or the radius of turn, is defined as a radius Rc. The distance between the center of the turn and the 
Wersection point of the outer side of the vehide body and the line extended from the rear arfe axis s denned as a 
r«?ius Ro TS^ distance between the center of the turn.and the intersection point of the inner sde of the veh.de body 
and the line extended from the rear axle axis is defined as a radius Ri. The radiuses Rc. Ro and Ri are expressed by 
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the following equations. 

Rc= (LAana)-{Tr/2) 

Ro=Rc+W/2=(iytBna)-(Tr/2)+W/2 W 

Ri^Rc-W/2=(IJlana)-(Tr/2)-W/2 (5) 

10038] The CPU 14 computes the predicted path based on these equations and moves to step S3. At step S3, the 
rPil i4determines the coordinates of the ends of each line 17a, 17c, 17d. . a* * cc ♦k^ 

4 converts the circle of the predicted path into an ellipse. As shown in Fig. 6. the or.g.n of the polar coord.na^ 
matches t^^^^^ of the circles of radiuses Rc. Ro and Ri. The x axis of the polar ^oord.nates matches the ax.s of he 
Te^Se Rg 6 sh^^ a line that makes an angle p from the x axis. The coordinates of the node P of the l.ne and the 
drde ?the ?aLsTo is defined as (Ro. p). The coordinates of the node Q of the line and the circle o1 the rad.us Ri .s 

The?^lar coordinates (Ro. p) of the node P and the coordinates (x, y) of the node P in the x and y coordi- 
nates satisfy the following equation. 

x=Rocosp, y=Rosinp 

10041 1 Likewise, the polar coordinates (Ri. p) of the node Q and the coordinates (x. y) of the node Q in the x and y 
coordinates satisfy the following equation. 

XsRicosp, y=Rosinp 

100421 When the circle of fig. 6 is converted into the ellipse, the nodes P. Q are shifted to nodes R, S. 
[o0431 The coordinates (X. Y) of the node R in the x and y coordinates satisfy the following equations. 

X«Ricosp. Y=bsinp 

10O441 Likewise, the coordinates (X. Y) of the node S in the x and y coordinates satisfy the following equations. 

X=Ricosp. Y={b-W)sinp 
10045] Wherein the value b satisfies the following equation. 

b«Ro{minor axis/major axis) 

40 100461 The CPU 14 converts the circle of the predicted path into an ellipse and converts the coordinates of the 
Sitose into Dofar coordinates. The CPU 14 then generates the guide frame data based on the converted elhpse coo d.- 
nates Tha So o'^ e minor axis to the major axis (compression ratio) is previously computed through test drives of the 
vphicle 1 and is stored in the program memory 1 5a. . . ^. ^ 

wJSl CPU 1 4 moves to step S6 and displaces the guide frame 17 from its accurate ocat,on. o-^^P^^^d 'n^^ 

Lcreen 19 of the monitor 4. by a predetermined amount. The displace amount is pr«.ously computed through test 
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fo'^r' Jhe C?u' iro5;rL"dr'rthe%ulde frame 17. the fixed frame ao. the marKer 21 and the ohstade 
1^ 22 to the monitor controller 13. The monftor controller 13 superimposes the data onto the .mage captured by the 

foS? ' "^Xe^^'^'^^er^n, assist apparatus 10 when the vehicle 1 is moving bacR^ard i" an S-shap«J 
oad is asfoll«L When the driver shifts the shift lever 5 into reverse, the guide frame 17. the fixed frame 20. the rnarkw 
Li ar^5?^eoSScle finder 22 appear on the screen 19 of the monitor 4. F.g. 7 Illustrates a case where the veh«:le 1 js 
mov2 LacSSS along an S-sh^ped road 24. In this case, the driver uses the guide frame 17 and .gnores the fixed 

'Ce Z^Xes s state of the screen 1 9 when the vehicle 1 is at a posHion A in Fig^ 7 or when the vehicle 
ifLihJ^Sough arightward corner. Rg. 9A illustrates a state of.the.screen 19 when the vehicle 1 is at a posibon B 
in Fir? 2l3e veLe 1 is moving through a leftward corner. The f «ed fr 

not deformed regardless of the steering angle a. The guide frame 17 is defomied in accordance with the angle a. 
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rooBi 1 The driver manipulates the steering wheel 8 such that the lateral line 1 7a of the frame 1 7 is located at the 
Lnior of the road 24 The guide frame 17 is generated based on the predicted path, which is calculated according to 
^hTirrent angle a of'the front wheels 7a. Thus, if the guide frame 17 is located in the center of the road 24. the vehicle 

ine curteiii ai u:.,._^_ u„ .u^ inrfi/.=*oH huihe frame 17. However, the cur- 

1 will not deviate from tne roao<:'» unui me veii.u.B . , - -■ - _ 

vaiure of the road 24 is not constant. Therefore. H the angle a is not changed, the guide frame 17 will indicate that the 
oath o1 the vehicle 1 deviate from the road 24. Manipulating the steering wheel 8 to adjust the lateral line 17a to the 
center of the road 24 changes the wheel angle o to a value corresponding to the curvature of the road 24. As a result, 
the vehicle 1 is moved backward along the road 24. 

roD521 Fig 9B shows the screen 19 when the lines 17a. 17c, 17d of the guide frame 17 are parallel. In this case, 
Lven if the curvature of the guide frame 17 is the same as that of the road 24. the cuivatures appear different to the 
driver which confuses the driver. Therefore, generating the lines 17a. 17c. 17d to extend between points on the same 
radius as in Figs. 8 and 9A permits the frame 1 7 to appear natural to the driver. 

roDsai Parallel parking of the vehicle 1 using the steering assist apparatus 10 will now be descnbed with reference 
lo Fins 10A to 1 1C The driver first shiMs the shift lever 5 into reverse. Then, the driver makes sure that the space 
behind the vehicle 1 is clear. The driver also confirms that the vehicle 1 is separated from the rear of an adjacent vehicle 
Cbvaooroximately fifty centimeters. The driver starts backing the vehicle 1 with the screen 19showingparlof aparWng 
«5ace 25 as shown In Fig. 10A. The driver slowly backs the vehicle 1 vM\e manipulating the steering wheel 8 such that 
the marker 21 matches a corner 26 of the parking space 25. When the marker 21 oh the screen 19 matches the corner 
26 aTshown in Fig lOC after the state of Fig. 10B. the driver turns the steering wheel 8 in the direction opposite to the 
steerina dkecfion of Fig. 10A. Accordingly, the wheels 7a are steered as shown in Fig. 1 1 A. The driver backs the vehic^ 
fu^^me comer 26 is out of the range of the screen 19 (Rg. 1 1B). When the side line 20a that is close to the curb 
becomes parallel to the curb, the driver puts the steering wheel 8 back to the straight position and stops the vehicle 1 
(Fio 11 C). In this manner, the vehicle 1 is parallel parked. 

ro0S41 The driver should make sure that segments 17e of the side lines 1 7b between the cross lines 17c and 17d 
fire snaced aoart from the cuib. If the vehicle 1 is moved backward w«th the segments 17e overlapping the curb the 
ulhic^l will run onto the curb. Thus, if the segment 17e overlaps the curb, the driver will repeat the parking procedure, 
rnossi K the oarking space is relatively short and the starting point and the entry angle of the vehicle 1 are out of 
IhraDoroDriate range, the vehicle 1 may contact the vehicle C. Specifically, backing the vehicle with the steering wheel 
a maiimaHv rotated after the marker 21 matches the corner 26 can cause a front corner of the vehicle 1 to collide with 
fhT^^hide C in such a case, one of the obstacle sensors 6 detects the vehicle C before the vehicle 1 contacts the vehi- 
cle C and sends the first obstacle signal and the second obstacle signal to the CPU 14. The corner marker 23a is 
chanaed to a state corresponding to the first or second obstacle signals. This permits the driver to see that front left 
corner of the vehicle 1 wlU contact the vehicle C by looking only at the screen 1 9. If the corner marker 23a is in the state 
corresDondino to the first obstacle signal, the driver continues moving the vehicle 1 backward. If the corner marker 23a 
Ts nTe state corresponding to the second obstacle signal, the driver stops the vehicle 1 and looks back to )iidge 
whether the vehicle can be moved further backward v«thout interfering with the vehicle G. Alternatively, the driver 
restarts the parking procedure after changing the entry angle. ^. , ^. 

roosei Parking the vehicle 1 perpendicular to a reference line such as a curb and reversing the vehicle directon 
Linn the aooaratus 10 wrill now be described writh reference to Figs. 12A to 12D. The driver first approaches a parking 
soaM 25 Then looking at the monitor screen 19. the driver backs the vehicle 1 whHe manipulating the steering wheel 
8 such that the lateral line 17a of the guide frame 17 matches the center of the parking space 25. When the vehicle 1 
reaches the far end of the parking space 25. the driver stops the vehicle 1. In this manner, the vehicle 1 is parked per- 
. pendicular to the reference line. When the driver wishes lo switch the vehicle direction, the driver shifts the shift lever 5 
to the drive position and moves the vehicle fonward. 

r00571 When parking the vehicle 1 perpendicular to a reference line, the driver may use the guide frame 1 7 and the 
fixed frame 20 or the line 21a of the marker 21. In this case, the driver approaches the parking space 25. Then, the 
driver manipulates the steering wheel 8 such that the guide frame 1 7 is located in the parking space 25 wHh a sufficient 
maroin about it as shown in Fig. 12A. Keeping the position of the steering wheel 8. the driver starts backing the vehicle 
1 When the side lines 20a of the fixed frame 20 are parallel to the parking space 25 or when the line 21 a of the marl^er 
. 21 is oerpendicular to the rear end of the parking space 25 as shown in Fig. 12B, the driver turns the steering wheel 8 
to the straight position as shown in Fig. 12C. Then, the driver moves the vehicle 1 to the far end of the parking space 25. 
[0058] The above embodiment has the following advantages. 

(ime width of the guide frame 1 7 corresponds to the width of the vehicle 1 . The guide frame 1 7 is at the reference 
position when the steered angle o is zero, or when the front wheels 7a are at the straight line posHmn. When the 
steering means (steering wheel 8) is manipulated, the guide frame 1 7 is swung to left or to right in accordance with 
the angle a When moving the vehicle 1 backward in an S-shaped path or vKhen parking the vehicle 1 perpendicular 
to a reference the driver manipulates the steering wheel 8 such that the guide frame 17 is located in the center of 
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the path, which permits the vehicle 1 to be easily moved to a desired location. 

io, Th. CPU 14 computes the steered angle a based on the detection signal of the angle sensor 9. CPU 14 

(2) The CPU 1^4 compile a ^ superimposes the guide frame 17 on the 

then computes the predicted pain oi '"e ven c „,Z,a,„n,\„^ nuide Irames corresponding to various 

image captured by the camera n. mus.. uai« ,^.^<>^ i - - 

angles a need not be stored in a memory. 

r-,. The CPU14computes the predicted path of the vehiclel using polar coordinates. Theguidefra^^ 

(3) The CPU 1 4^mp^ P ^^^^^^ ^ ^^^^ the guide frame 17 is bent in 

IS>rdar;ce with the cu;;Su^^^^ 
tal with respecl to the screen 1 9. 

S e^K2:e%r^^^^^^ 
l\h me driS^mr^^^^^^^^^ Wheel 8. As a result, the rear wheels 7b do not run onto the .ner curb. 

,« -ru <r«me 1 7 is disDiaced from the position accurately corresponding to the ellipse of Figs. 6 in the mon- 

5) The ^^;J'^^;^''^^^'XrB the guide frame 17 is not displaced, the guide frame 17 is swung w.*, 
eriee' g mSoTi alTthe dr^,er steL the wheels 7a by wHh less movement of the steering wheel 8. 

whfch prevents the rear wheels 7b from approaching the inner curt, too closely. 

,e) The cirae of the P--- P- ';:X::^;^:iZ!^^r^ ^Z^^S:. 
fXtrZr- ^Ten^s^^STe^en^;^^^^^^^ 7b frc^ approaching the inner curt, too Cosety. 

(7) Theguidefr^e17in.udesa^^^^ 

line 17a is separated , , j^, , ^ ^^e curbs when moving the vehicle backward along 

manloS ai^urt wi brappropriate. The side lines 17b and the cross Unes 17c. 17d connec^ng the SK«e lines 
Xerm!rS"erfo estimated 

(8) The marker 21 is fixed In the screen 19 of the monitor 4. which fadlrtates parallel parking of the vehicle 1. 

T „4 obstacle sensors 6 are located at the front corners of the vehicle 1. Based on signals from the sen- 

(9) Two °H^e ^^.^^^ ^^^^ ,g ^ „ „e angle of entry is not pmper 

wh"n paraK^^^^^ 1 • *e saeen 19 warns the driver of an obstacle before the veh.de 1 contacts 

wohirie Accordinalv the driver can avoid contact w/ith the vehicles. 
Z^f^^n^Sh^^e Obstacle sensors at their body comers. These vehicles either produce warning 

» c^l^»in*". Mt. and m. width of s parWns space. In otf,» worts, the mrter 21 and 1l,a fn«d f»n« 
20 facilitate parallel parldng. 

n ^^ The fixed frame 20 and the guide frame 17 are displayed at the same time on the screen 19. Thuj. v|Ji«? 
distance between a cuito and the center segment of the nearest side line 17b. 
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Th. monHor 4 is not exclusively designed tor the steering assist apparatus 10 but is also used as the monitor 
o a na^rn s i;^^^^^^^^ reduces the cost. The navigation systerr,is not us«. when the veh.c.e .sbemg rr^ved 
tockward. Therefore, using the same monitor lor both purposes causes no problem. 

n.. The imaae of the camera2 is in black andwhite and the guide frame ^^^t^^^^^^l^/.! ° tl^lr^L': 

^ " ' _.. . J ^i«r r omnared to showinq everyining on me screen i » h i wwiw. , n h-. 

Z cS Alfo Th?i"ck aXht Li"^^^^ gives the color guide 17 prominence. Further, the black and 
whHe Sage o, The c^rnera 2 reduces the amount of data processed by the CPU 14. 

ThP distance between the far end of the view of the camera 2 and the rear end of the vehicle 1 is K^ger than 
(14) The distance ' 19 shows the road beyond the guide frame 17. Therefore, when back- 

,he length of the vehicle 1 _ "^u^. J^^^;^; j^^j"^^^^^^^^^ steering wheel 8 such that the guWe frame 17 is 
Tocarraft^lTclJeroftht^^^. Sch gtes tSe drivel the feeling that the vehicle 1 is backing to the desired .oca- 

*°" a ««,nd embodiment will now be described with reference to Figs. 14 to 17. The second embodiment is dif- 
. «nHrortt.VfJS^rJESmentinthemethodforcomputingthepredicledpa^ 

ferent from tt^f^^ emDOO computed based on the manipulation state (manipulation tendency) of 

second embodimerit. ^^^^ P f based on the speed of manipulation {steering speed). 

'"'trscrliinihe^^^^^^^ 

As describea in xne However, manipulation of the steering 

.^toLltTthe ^^^^^^ Of the road varies from one driver to another. For example, one 

Sve ' Z rotaie ll steeSng wheel 8 at a different steering speed from another driver. The apparatus according 
lo the second embodiment takes the tendency of each driver into account 

1 when a vehicle moves along a corner of a road, the steering speed changes as shown in Fig. 15. 

-ru ° ??Ht;^rro^he comTr^he steered angle of a steering wheel is zero. As the vehicle moves along the 
IJr'nJr me Steering' whle! a^le gradually is increased until H is maintained at a certain angle. Then, the steering 
^^I '^ai^TSS decreased toward the exH of the corner. At the exit, the steering wheel angle returns to 
r™ n oSier wcSsC an^le of the vehicle wheels is gradually increased until it corresponds to curvature of 
fhe cu^le T?e oi the wheels is maintained for a certain time (certain distance). Then, the anQ«e cj'he «he^^^^ 
♦ 1^ nraiu^v decreased Fig. 15 shows the relationship between the rotation angle of a steerir^g v^eel and 
Zi.stanc^SXTev^^^^^ 

I^^iS as n F^IS the vehicle wheels and the axial center of the rear axle are moved along Palhs shown 
P n 1 G l^ine LI sho>^ the path of the inner rear wheel. Une L2 shows the path of the outer rear whee^. Une L3 
shows thrith onSHiner ^t wheel. Une L4 shows the path of the outer front wheel. Une L5 shows the path of 

''''^lnth^ve^iSe^smotS 

tain t^ a^i isSia^^^^^^ according to the «me (distance). This is true no. only for a right angle comer but also for 

" wevenicie is .—^..ed based on the angle of the vehicle wheels, which con'esponds to the rotation 

« Circular. The angS). !nd vehfcle measurements such as the wheelbase. H the steering 

Wheel i rot^i ra'c^nSriTeS^^^^^^^^ of the vehicle will be inside of the circle drawn by a veHCe with the 

'''iTiiroiiSSSatsCl^g'SLce marking such as the guide frame 17. on a monitor for assisting steering 
« ,he I^LaS he gSinS maria'ng on the monitor is determined in accordance with the '^--"'^J^^""^^^^^^^ 
the ocafion 01 ine B predicted based on the current steering wheel angle, and the guidance 

angle. Specif 'cally, the path ot me ve^^^^^ ^ representation of the location of 

r^^Tnrm^lL^fl?' slen by t^^^^^^^ t^^e predicted path of the vehicle. The driver 

m^nCt^theS^^^^ wheel suSthat the guidance marking is aligned wHh the center of ti.e road. _ 
£^he drSer starts rotating the steering wheel, the guidance marking does not match the road 2jk Specrt- 
i,:anvTe cui^atre of the guidance marking is less than that of the road 24 as shown by the unrto|Tnly dashed line 
of ng ^7 ^s mS «use the driver to oversteer to match the guidance marking with the road 24. The dr^er would 

•^"^rSlJe ;:hi^^^^^^^^^^^ the steenng wheel by a small amount and observes the guid- 

uinn 1 ?hrmonitor saeen At this time, the driver feels a need to rotate the steenng wheel more. Even- 
" SCurn^mS i'r^^^^^ the position o, the uniformly dashed line to that of the soHd l«e wt, ch 

eSr aSng the center of the road (see Fig. 1 7). However, in this case, the driver ro ates the steermg whee reN 
- _ Sy quSy AS a result, the vehicle wheels.are oyersteered and the vehicle runs onto the inner curb of the road 
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path (which IS represemea oy xne y . ^ , steering wheel 8. That is, if the 

:t:e:;n7s;:;;ysfov.. Thus, the guidanc^^^^^^^ ^ 

the driver to slow down the steering ^P^ff ^^^^^^ llStt tha the apparatus according to the second 

;^re?oSo"?r^^^^^^^^^^^ 

hrnensr^rirrssir" 

a,emory 15a stores a program '^P^^^^'f^^^.^^'^^^^^^ intervals. The CPU 14 stores the 

''ie ^InTtrprrouTa^: a i^t^^^^^^^^^ — ry 15b. Every f^e a new 

current angle a and the P^f^'""^ ^^^'^ ^ Th^ CPU 1 4 then computes the pivoting speed of the front 

angle a is ;f r'^.'lS.^^^^Jjfb^^^^^ angle ab and the current angle aa. The CPU 14 rrultipl.es 

wheels 7a based on the difference ''etween ine pre^ a correction value and adds the correction 

the steering speed ^"J/^P;^,^--^^^^^^ p. The CPU 14 predicts the path 

^MhV^eHc^^^^^^^^^^ P^-^^'--'""^ "'^""^'^ ^""^ ^'"'"^ 

experiments and stored in the program "memory 15a. described. When receiving a 

"""^^r^rs^rj^r'sTs [n^;:re "h CP^uI^ the guide f«me 17 In 

signal indicating hat the sh^^^^^^ a ^'Setermined intervals (for example, thirty-three milliseconds), 

accordance « ^^.^''^^^'^J feaTs the wheel angle a from the controller 12 and renews the whee ang e data 
gs Atstep S10. the CPU ^ * '^^''f /"^ JT^^^^ 

stored in the working memory 15b. A' ^'f Pj/^Jl^^f^.^J^^^^^^ ^ „om two cycles of the routine. M the deter- 
or aset representing the angje o^^^^^^^ ^^^^^^^ ^ CPU 14 moves bacK to 

minatton IS pos*ve me CPU 14 m^^^^^ steering speed based on the difference between the cogent 

S^^eflngle c^Tnd th'e preSo^ ^e.^Z,^. ob and moves to step S13. At step S13. the CPU 14 computes the 
predicted p^h in a«^rda,,cew^^^^^ 

Atstep SI 3. the CPU 14 muK.piies 'r^^f '==""9 ^ wheel anale o The resultant is defined as a provisional 
rectlon value and ^"^^^^^^^^^ rplT^S pTh based on the equations (3) to (5) of the first 

current wheel angle p. Then, the CPU ^^e, ^ngie p is greater than the current wheel angle 

embodiment If the steering !P«^^^"f^^^^;*^^^^^ fhe currenTpredlcled circle. When the steering 

a. and the radiuses Rc. Ro. Ri become shwter than the radiuses w ine h „edicted path circles 

speed IS zero, the P-^f -•^^J^fcP^ i^TeSm ne^^^e c^^^^^^^^ of each Hne 17^. 17c. I7d. 

rthTm^c:jtoro:=3^rr=^^ 

"°T;Son to the advantages (1) to (3) and (7) to (14) 01 the f irst embodiment, the ^^^^ 

following advantages. 

the apparatus properly assists the steering, 
ing speed. 
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waii.p Of the wheel anale is computed by multiplying the steering speed with a predetermined 

TthW en^odiment will now be descrtoed. The third embodiment is dWerent from tt,e second embodiment ,n 
A third emDooime on ,he steering speed but also on the vehicle speed. 

rmtr/ss^med value, the guide frame 17 is not displayed at the proper location on the screen ia 

irom the assumed ^lue g ^^^^^ ^^^^^^ ^^.^^ ^^^^^^ ^ ^^^^^^^ , 

,he ^ihic•|e is diJeS omVh^ ^h^^^^^ vehicle speed is constant. For example, if the vehicle spe«. .s increased, 
the vehicle is *"ereni , ^ decreased, the curvature is increased. 

''^TTurSsnJ^^^^^'^-.e^^^^ the predTcted path is corrected wHhout considering vehicle speed 
K « ThS Tthe sfeering speed is constant, the correction amount is constant. The gu««e frame 17 .s not 
S thl veScle i'eS is increased. Therefore, the vehicle 1 is gradually displaced outward as rt moves 

bacKward. The third en^bj,^nt ^^^^l^'^^^^fl^^^^^^^ ,„ .Edition to the members of the first and sec- 
H ^t^re^^heS em^^^^^^ t 'e second embodiment in the control programs stored in the 

ond ^^''^'^■Vl^''^^^ executed by the CPU 14. The program memory 15a stores a program 

rSZTrZZll « ^FSTLroTthe saL reference numerals are given to those components that 
L^Srorthe^meast^^^^^^^^ 

in step S1 Om the CPU 14 reads a signal of the wheel angle a from the controller 12 ^^'^"^l^^tf. 

. ^ fi^Jo^e?■in the working memory 15b. The CPU 14 also reads vehicle speed data v. At step S11 the CPU 
angle data ^^^^^^^J^^X^w^TS data ca and ab of two respective cycles are stored in the workng mem- 
14 judges wheth^lvvo srts c^f whe^^^^^^^^ 14 moves to step SI 2. If the determination is negative the CPU 14 

ory 15b If the ^^^^^^TeX 1^^514 ^ speed Ve based on the difference between 

;ht;:;:rinrs/e; aiTgif ^^^^^^ <^ ^ '^'^^ 

^''''tt'^']^ Sltr? ^ e'??u 1 4 computes a steering arT«unt C per unit distance traveled by the vehicle 1 based on 
the steering speed Ve and the vehicle speed v using the following equation. 

C=VO/v 

Thp CPU 14 then multlpfies the value C with a predetermined coefficient and adds the ^""^"^ 
u . ^ tLVcpU^ defines the resultant as a provisional wheel angle p. Using the value p. the CPU 14 
rdTulThfprSctS^patL blS"^^^^^^^ e<^ations (3) tS (5) of the f .st embodiment. The predetern«ned coefficient 

''t:"<S:;S:r™crar^^^^^ - —dance wHh the steering 

.oeJ? Ce S^eSnQ s^e^l ve is zero, that is. if the steering wheel 8 is not being ™tat«l 'he corrector, value 
?s a?o zero Tn tSs casS. tSe provisional current wheel angle p is the same as the current wheel angle. The pre- 
dicted path cirde is the same asjho^e jr^ruteTSS S^A S15 and S1 6. Accordingly, the monHor con- 
tro.lerii"po1^~^^^^^^^ 

°' *'?h7ti;w embodiment has the same advantages as the second embodiment except the advantage (18). Fur- 
ther, the third embodiment has the following advantages. 

/1« Th^ nredicted path is corrected in accordance not only with the current steering speed Ve but also with the 
SJe speS V TheSo^. the guide frame 17 is displayed at a proper location regardless whether the steenng 
rhe?8fe b^ng rotated. Even if the vehicle speed v is changed, the guide frame 17 .s properly ad^isted. 

«m -r>,P rorrection value is obtained by multiplying the steering amount C per unit distance traveled the vehicle 
wiSJepreSSmintl^^^^^^ 

""Molre"X"n?of1;e present invention will now be described wHh reference to Fi^. 19 and 20. The 
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<n..,ih embodiment is the same as the lirst embodiment except for markers used in parallel parking^ Like or the 
same rete^rnumerals are given to those cor^onents that are like or the same as the correspond.ng compo- 



«4 4 u e^mbodiment. „ . 

"""L"'.hi^n"in FiQS 20A to 20C. the apparatus of the fourth embodiment has two markers 27a. 27b »or parallel 
oark?a ?rmarKS 27a is usL when pSfallel parking a vehicle to a parl^ng space located »o the 'eft and behind 
parking "^f . . ^ J^^^ parking a vehicle to a parking space located to the right and 

^H?d Ih! vSidr^^^^^ 27ris"SS on a Ene emended from the right side of the vehicle 1 . The marker 

ITslJ^rt^^irc^^^^^ the vehicle 1 (the rear bumper 3) by a predetermined distance The marker 
27b s IcSS on X extended from the left side of the vehicle 1 . The marker 27b is separated from the rear end 
nJthe 1 ("he re^r bumper 3) by a predetermined distance. Auxiliary lines 28 extend rearward from the mark- 

ers 27^251 T?e auxiliaryZes 28 extend from the side lines of the vehicle 1 and are = 

1 1 !UonH hrtween the markers 27a, 27b and the bumper 3. When a parking space is located behind and to the 
^^o? ^ifvehicS^ ?he mX 27a is used. When a parking space is located behind and to the right of the vehicle 

' ' ^'xhTor'SSe tofdttermining the location of the marker 27a will now be described. In Fig. 1 9^a target location 
ai thi veSI^ is fflustrated by dotted lines. A corner that corresponds to the rear left corner of tt,e targe^vehicle 
of the vehicle 1 IS " ^ E a„d the rear axle is the rear overtiang of the vehi- 

cTl WhlStetNcter^^^^^^^^ wheels fully rotated, the inte.ection point of the «ne ^cl«fing 

Z r^r^e and the right side line of the vehicle is moved along a circle of a radius ( Rc-W/2 ). m whjch W « the 
^rhh o t^e vScle 1 V^en the tangent of the circle includes the point E. the intersection point « defmed as a po.m 
widthof the 'JT" ^ incudes the point Flp and the point E. and a line parallel to the cuito 

T T nSnt deSed as angle y is a preferred angle at which the vehicle 1 should enter 

including the po^nt ^f^^^^^'^^^,;",?^",^^^^ the point E and the center O of the turning and 

Te lirrSg b'TertJeTntr^^^^^^^ is defined as an -Q-e a" T^e fol.c^ing^^^^^^^ are 

satiSTdfetance between the center O and the axial center of the rear axle is defined as a distance Rc. 

OE = TicRcTwTiF+a^ 



cos a" = oRp / 



. (Rc - W/2) / .y{(Rc+W/2)^ +a'') 



. . a" = COS ^Rc - W / 2)/ ^«Rc + W / 2) + a ) 
.-. RpE'c ORp tan a" = (Rc - W/2) tan o" 

Thus the distance DA between the point E and a point Re, which is separated from the point Rp by the dis- 
tance a oi the vehicle overhang satisfies the following equation. 

DA=(Rc-W/2)tana"-a 

The location of the marker 27a when the entry angle is the angle r is obtained based on the ^^"ation The 
distaTlie SA^ adjusted through experiments in consideration 

^iVparallel parking the vehicle 1 in a parking space located behind and to the right of the vehicle 1 . the 
marr2;bTused A corner of the parking space corresponding to the rear right corner of the v«l^^e 1 « deter- 
mfnS as the point E. Then, the location of the marker 27b Is computed in the same manner as the procedure for 

"'Vj^X^^^^^Sp-'^^^^^ P«'W"B^« "^'"9 the marker 27a in a parking place located behind 

A !^Tho1pft rf «^e vehicle 1 will be described. When the driver shifts the shift lever 5 to the reverse posrtion. the 
scrVen lS Spfa^paS ofa paTwng space 25. The driver slowly backs the vehicle 1 . At this time, the driver rotates 
thT^;JrJng wt28%uch that the auiary line 28 corres^^^ 

oarSia wace 25. or with the corner 26. as in Fig 20B. When the corner 26 matches the aux lary hne 28. the dr^e 
JTe steering wheel 8 to the straight position and continues slowly backing the vehicle 1 . When the rnarker 
r^urns p goC. the driver switches the steering direction of the steering wheel 8 

and ^ctat he'stS Siee, 8 Xl^e way to the lim«. In this state, the driver ba^ J-ehicle 1 the comer 
S is oiJ of ie view of the screen 19. When the side lines 29 are parallel to the curb, the driver returns the steenng 
wheel^to the straight position and stops the vehicle 1 . The parallel parking is completed in th« manner. 
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When parallel parking the vehicle 1 in a parking space located behind and to right of the vehicle 1 . the above 
procedure is performed by using the marker 27b. 

Compared to the case where the marker 21 o1 the first embodiment Is used, the fourth embodiment has the 



<2^^ Comoared to a case where the marker 21 is located to apparently intersect the longitudinal axis of the vehicle 
1 the angle y of entry is greater when parallel parking the vehicle 1 . That is. the angle t defined by the entry direc- 
tion of the vehicle 1 and the curb is greater, which facilitates the parallel parking. 

(92) Compared to a case where the marker 21 is located to apparently intersect the longitudinal axis of the vehicle 
1 the vehicle 1 can be moved backward by a greater distance with the steering wheel 8 at fully rotated position. 
Thus the driver can take his eyes from the monitor 4 to look about for a relatively long time. 

A f ifth embodiment of the present invention will now be described with reference to Figs. 21 and 22. Unlike the 
tourlh embodiment, the target point for parallel parking Is not the corner 26 of the parking space but is the center 
Doint the curb of the parking space. A marker is matched with the center point when parallel parking. The locations 
of the markers 27a and 27b are opposite of those of the fourth embodiment. That is. the marker 27a is located on 
a line extended from the left side of the vehicle 1 and is separated from the vehicle rear end (the rear bumper 3) by 
a predetermined distance. The marker 27b is located on a line extended from the right side line of the vehicle 1 and 
is separated from the vehicle rear end (the rear bumper 3) by a predetermined distance. 

r00591 The marker 27a is used when parallel parking the vehicle 1 in a parking space located behind and to the left 
of the vehicle 1 The procedure for determining the location of the marker 27a will now be described. As shown in Rg. 
22 a center point in the longitudinal direction of the parking space is defined as a point E\ The position of the vehicle 
1 when it is Darallel parked is shown in dotted lines. If the vehicle 1 Is moved from the posHion of the dotted lines with 
the steerina wheel 8 is fully rotated, the intersection of the line extended from the rear axle and the left side line of the 
vehicle 1 defines a circle, the radius of which is ( Rc+W/2 ). When the tangent of the circle includes the point B\ the inter- 
section point is defined as a point Lp. The angle defined by the tangent, which includes the point Up and the point E\ 
and a line parallel to the curb including the point is defined as an angle y\ The angle y is the angle of entry of the 

so moirm ^ * A triangle including the point E\ the center O and the point Lp is a right triangle. The intersection point of the 
side line of the vehicle 1 including the point E' and a line including the center O and the rear axle of the vehicle 1 at the 
position shown in dotted lines is defined as a point Q. The triangle including the point E\ the center O and the point Q 
^ also a rioht triangle Since the length of the line OQ is the same as the length of the line OLp. the triangle of the points 
F' O and Ld is a mirror image of the triangle of the points E\ O and Q. Thus, the length of the line LpE' is the same as 

35 the lenqth of the line Et). The length of the parking space is Ls. Half of the line Ls. or the line Ls/2, is equal to the sum 
of the line E'Q and the overhang a. The distance between the point Lp and a point Le. which is separated from the point 
LP bv the overhang a. is defined as a distance DA*. The distance DA' is equal to {Ls/2-2a ). 

rooei 1 The markers 27a. 27b are used in the same manner as the fourth embodiment when the driver parallel parks 
the vehicle 1 except that the markers 27a, 27b are matched vwth the center of the parking space, not with the corner of 
40 the parking space. The driver matches the auxiliary line 28 and the marker 27a. 27b with a center of the parking space, 
which is marked for example, by a tile located at the center of the parking space. 

r0062] In the fifth embodiment, the angle of entry y* is greater than the angle of entry of the fourth embodiment. In 
other words, even if the angle of the vehicle 1 to the curb of parking space is relatively great, the vehicle 1 is easily par- 

45 rOMsf ^^'^A sixth embodiment will now be described with reference to Figs. 23A. 23B. 23A and 24B. The sixth embod- 
ment is the same as the fourth and fifth ennbodiment except for that the markers 27a. 27b are not extension the side 
lines of the vehicle 1 but are parallel to the side lines 29. That is. the auxiliary lines 28 of the markers 27a, 27b are par- 
allel to but not aligned with the side lines 29. The locations of the markers 27a, 27b are changed in accordance with the 
target point the proper angle of entry and with the displacement amount of the auxiliary lines 28. 

so rOM4] For example, if the target point E is a corner of the parking space closer to the curb as shown in Fig. 23A 
and the auxiliary line 28 is located outside of the side line 29 by a certain amount, the location of the marker 27a is com- 
puted in the following procedure. The intersection point of the line that is parallel to and separated from the side line of 
the vehicle and the line including the rear axle is defined as a point P. When the line includes the point E, the angle 
defined by the line that includes the points P. E and the line that includes the point E and is parallel to the curb is defined 

55 as an angle y" of entry. A point that is separated from the point P by a distance corresponding to the overhang a is 
defined as a point Pe. The following equations are satisfied. 



PE^ = OE^-OP^ 
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eE^ = (Rc + W«)Sa' 
5P = (Rc-W/2)-S 



PeE = PE - PPe 



= 7«Rc + W/2)^ +a='-(Rc-W/2- S)^)-a 
[0065] The location of the marker 27a on the screen 19 is separated from the bumper 3 by a distarwe correspond- 

Sir ' Vif sh^ws a case where a comer corresponding to the rear right corner ot the parked posrtlon of the 
Si 1 is defined as a target point E". The auxiliary line 28 is spaced from the side of the vehicle by a certain distance 
TtZ marker 27a is computed in the following manner. An intersection point of the axis of the rear axle and a line pa^ 
In Jto «?e side of the vehicle 1 and separated from the side of the vehicle 1 by the distance S' is defined as a point P. 
,5 TiS InSe o entVy of the vehicle 1 is defined as • A point separated from the point P by a distance corresponding to 
iJl oTe?hang a is defined as a point Pe. The angle of entry y~ is greater than the angle f shown .n F.g. 23A. The fol- 
lowing equations are satisfied. 



OP =(Rc- W/2) -S* 



25 /. PeE = PE - PPe 



-(Rc-W/2-S')M 



[00671 As shown in Fig. 24B. the location of the marker 27a on the screen 1 9 is separated Ironn the rear bumper 3 
L *K Ji«r,«*K rtf the line PeE" and is separated from the line 29 by the distartce o1 S'. 

?00681 ?he marte^s'l 27b are used in substantially the same manner as in the fourth and fifth embodiments. 
Tho rtiffercnce is that the target point is varied in the embodiment of Figs. 23A and 24B. 

mMo ^ is the locations of the markers Z7a. 27b are determined based on the target point and the angle of 
eTy of the vehicle 1 during parallel parking. Depending on the location of the markers 27a. 27b. the driver fully rotates 
«ho eteprinn wheel 8 at different times. ..... 

rooTOl It should be apparent to those skilled in the art that the present invention may be embodied in many other 
Sc forms without darting from the spirH or scope of the invention. Particularly. H should be understood that the 
■nueniion mav be errtbodied in the following forms. . . j 

MtT Tthe Surth to sixth embodiments, two markers 27a. 27b are used. Specifically, the marker 27a is i«ed 
.0 when oarallel parking the vehicle 1 in a parking space located behind and to the left of the vehicle 1 . The n,arker 27b is 
paSlel parking the vehicle 1 in a parking space located behind and to the right of the vehicle r In hese 
em^oS^^nte an Input means, or a switch, for signaling the location of the parallel parking space may be added to he 
aooaraJ^s 1 0 ■ Tn a^rdance with the state of the switch, one of the markers 27a and 27b is selectively shown on the 
screen 1 1 This fadlHates parallel parking compared to a case where two markers 27a. 27b are disp ayed on the screen 
SrStaneouTrrnstead of showing just one of the markers 27a and 27b. the marker 27a. 27b being used may bl.nk. 
TOs ateo^dlLes parallel parking compared to a case where two markers 27a. 27b are displayed .n the same v«y^ 
mo72 -Se S frame 17 on the screen 19 permits the driver to judge the relationship between the wK«h of the 
vehk:le 1 and the width of the road. The data representing the guide frame 17 are generated based on the wheel angle 
r <^nLHicallv the CPU 1 4 computes the circle of a predicted path of the vehicle based on the wheel angle a and con- 
verts tIJeSinates of the circle into polar coordinates. Then, the CPU 14 converts the circle of the predicted path into 
^ ^Itose >^en displaying the ellipse on the screen 19. the CPU 14 displaces the ellipse rean«ard from the accurate 
^afiS? instead the relationship between the location of the guide frame 17 and the angle a may be pre«/.ously 
m?ough experiments and stored in the program memory 1 5a. In this case, the CPU 14 selects a data of me 
legation of the guide frame 17 that corresponds to the current angle a. This eliminates the necessity for computing the 
dSa ri^senting the guide frame 17 thereby reducing the load on the CPU 14. Accordingly, the guide frame 17 is 
ntiicklv disolaved on the screen 19. ^ ^ . .-i 

?0073V The side lines 1 7b and the cross lines 17c, 17d may be omitted Irom the guide frame 1 7 such that the guide 
frame 17 only has the line 17a. This facilitates the processing of data for generating the guide frame 1 7. As long as the 
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relationshtD between the vehicle width and the width of a road is displayed on the screen 19. any type o1 display may 
be used. For example two dots corresponding to the ends o1 the line 17a or a guide frame representing the vehicle out- 
line may be used. « ^ ^ au -j.u < 4k« 
rnD'41 In the illustrated embodiments, the length of the line 1 7a on the screen 1 9 corresponds to the width of the 
vehicle 1. However, the lengm oi me iine i la moy uc = . —. - 

rooTSI '"^"Reqarding the lirst embodimenl. the compression ratio o1 the predicted path circle and the amount o1 rear- 
ward displacement of the guide frame 17 may be varied in accordance with the vehicle speed. For «cample. vehicle 
backino soeed may be divided Into two or more speed zones and the proper compression ratio and the displacement 
amourrt can be obtained through tests and stored in the program memory 15a. In accordance with the vehicle speed 
detected by the vehicle speed sensor, the proper compression ratio and the displacement amount are selected. This 
makes the auide frame 17 more accurate. . ^ 

m0761 When backing the vehicle 1 . the guide frame 1 7. the fixed frame 20 and the marker 21 are displayed on the 
Lcreen 19 However, only information necessary for the current state may be displayed. For example, a switch may be 
provided for switching the display state when the vehicle 1 is backing in an S-shaped road, parallel parking or perpen- 
dicular oarWna The driver selects the current situation with a switch to display only the necessary information on the 
sween 19. The obstacle finder 22 may be displayed only when parallel parking the vehicle 1 . Thus, unnecessary infor- 
mation ,he line 20b of the fixed frame 20 extends between the upper ends of the side lines 
20a The marker 21 is located at the center of the line 20b. However, the marker 21 is displaced upward or downward 
of the line 20a depending on the turn radius or the value of the overhang. In these cases, the line 20b is changed to 

foowi^^'^nl'! on^o?ufe guide frame 1 7 and the marker 21 may be displayed. If only the guide frame 17 is displayed, 
backing the vehicle 1 in an S-shaped road and perpendicular parking are fadlHated. If only the marker 21 is displayed. 

[0079]' ^'lUr^^efZ^y be changed as long as it corresponds to the center of the vehicle 1 . The line 21a may 
be omitted or be replaced vwth a dot. - >u 

roosol In the first embodiment, the CPU 14 converts a circle of a predicted path into an ellipse and generates the 
data reoresenting the guide frame 17 based on the ellipse. When displaying the guide frame 1 7 on the screen 19, the 
CPU 14 displaces the position of the frame 17 reanward from the accurate location in the screen 19. However, one of 
ihe eUiose conversion or the displacement of the frame 1 7 may be omitted. This reduces the load on the CPU 14. 
tOOSI] In the second and third embodiments, the coefficient for computing the correction value of the steering angle 
is obtained through drive tests. However, the coefficient may be obtained through computation. 
r00821 Instead of using the monitor 4 of a navigation system, an exclusive monitor may be used for the steering 
assist aooaratus 10 In this case, the apparatus 10 is easily installed in a vefticle having no navigation system. 
r00831 The obstade sensors 6 may be provided only at front corners of the vehicle 1. When parallel parking the 
vehicle 1 only one of the sensors 6. namely the front one closer to the curb, is needed. Thus, the sensors 6 are not 
needed for rear corners of the vehicle 1 . Alternatively, the obstacle finder 22 may be omitted. 

f00841 The obstacle finder 22 may be displayed only when one of the sensors 6 outputs a detection signal. Further, 
the obstacle finder 22 may Indicate whether the signal Is the first signal or the second signal. In this case, the obstacle 
finder 22 does not disturb the driver when the driver is checking the guide frame 17. 

ro085] In the third embodiment, the predicted path is computed based on the vehicle speed detected by the vehicle 
soeed sensor However, the CPU 1 4 may receive a vehicle speed signal from a vehicle control ECU. 
r0086] Therefore the present examples and embodiments are to be considered as illustrative and not restrictive 
and the invention Is riot to be limited to the details given herein, but may be modified within the scope and equivalence 

fOM71°''''^Asteeringassist apparatus (10) that assists a driver when backing a vehicle (1) in an S-shaped path or par- 
allel DarWng The apparatus displays guidance marking (17) on a monitor screen (19) and the driver refers to the guid- 
ance marking wrtiich permits the driver to easily back the vehicle to a desired position. The apparatus includes a 
camera (2) a'monitor (4). an angle sensor (9). obstacle sensors (6), an image processing unit (11). a controller (12) 
and a monitor controller (1 3). The image processing unit computes the predicted path of the vehicle at the current wheel 
angle The monitor shows an image captured by the camera. The Image processing unit generates data representing 
a Quidance marking based on the predicted path and superimposes the marking on the monitor screen. The location of 
the marking on the sween is determined based on the current wheel angle. The marking represents part of the pre- 
dicted path SpecHically. the marking matches the width of the vehicle In the monitor screen, a marking is separated 
from the rear bumper of the vehicle by a distance corresponding to the wheelbase of the vehicle. 
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Claims 



1 An apparatus ( 1 0) for aiding steering when a vehicle ( 1 ) is being driven in reverse, the moving direction of the vehi- 
riP beina determinedin response to the position o^steered wheels (7a), the apparatus comprising a camera (2) for 
caDturing an image of an area behind the vehicle and a monitor (4) tor displaying the-image captured by the A;a.i.- 
era characterized by a display control unit (1 1 ) for displaying a guide marking (1 7) for aiding steering, the marking 
and the image being simultaneously displayed on the monitor when the vehicle is being driven In reverse, wherein 
the marking (1 7) provides a driver with at least first indication of the width of the vehicle and a second indication of 
a prospective path of the vehicle corresponding to the position of the steered wheels (7a). 

2 The apparatus as recited in claim 1 . wherein the vehicle has a detector for detecting the position of the steered 
" wheels(7a) v^erein the display control unit (11) calculates the prospective path assuming that the vehicle is 

moved in reverse, on the basis of information from the detector, and wherein the marking (1 7) is displayed accord- 
ing to the width of the vehicle, and at least one mark is displayed to appear to be a predetermined distance behind 
IS the rear end (3) of the vehicle (1) on the prospective path. 

3. The apparatus as recited in claim 2. wherein the marking (17) includes an indication of a space that is as side as 
the vehicle in appearance, the space being located behind the vehicle in the image. 

20 4 The apparatus as recrted in claim 2. wherein at least one of the marking (17) includes an indication defined by two 
points that are spaced apart approximately by the width of the vehicle in appearance. 

5 The apparatus as recited in claim 2. wherein the marking (1 7) includes an end mark (1 7a) that approximately indi- 
cates the width of the vehicle in appearance at an apparent predetermined distance behind the rear end (3) of the 
vehicle on the prospective path and side marks (17b) extending from the end mark (17a) toward the rear end (3) of 
the vehicle, wherein the side marks (1 7b) are spaced apart approximately by the apparent width of the vehicle. 

6 The apparatus as recHed in daim 5, wherein the marking (17) further includes two intermediate marks (17c, 17d) 
* appearing between the end mark (17a) and the rear end (3) of the vehicle (1). each intermediate mark (17c. 17d) 

extending between the side marks {17b). wherein the intermediate marks (17c. 17d) indicate the apparent width of 
the vehicle. 

7. The apparatus as recited in claim 2. wherein the predetermined distance appears to be approximately the same as 
the wheel base (L) of the vehicle (1). 

8 The apparatus as recited in claim 5. wherein the display control unit (1 1) calculates the prospective path using polar 
coordinates and wherein the end mark (17a) is determined by a radial line extending from the polar coordinates. 

9 The apparatus as recited in claim 2. wherein, when the prospective path is circular, the display control unrt (1 1) dis- 
plays the path in an elliptical manner by compressing the prospective path in the longitudinal direction of the vehicle 
(1) at a predetermined rate. 

1 0. The apparatus as recited in claim 2. wherein the display control unit (11) shifts the indication of the prospective path 
in the direction of vehicle movement. 

11 The apparatus as recited in daim 2, wherein the display control unit (11) has an acquisition means (1 4) for deter- 
* mining the steering speed, and wherein the display control unit (1 1) calculates the prospective path using the cur- 
rent position of the steered wheels (7a) and a value obtained by multiplying the steering speed by a predetemnined 
coeffident. 
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1 2 The apparatus as recrted in daim 2. wherein the vehicle (1 ) has vehide speed sensor for detecting the speed of the 
vehicle and the display control unit (11) has an acquisition means (14) for determining the steering speed, and 
wherein the display control unit (11) calculates the prospedive path using the current position of the steered wheels 
(7a) and a value obtained by multiplying the ratio (C) of the steering speed and the vehide speed (V) by a prede- 
55 termined coefficient. 

13. The apparatus as recited in claimi , wherein the image is displayed in black and white and the marking (17) is dis- 
played in color. 
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14 An apparatus (1 0) for aiding steering when a vehicle (1 ) is being driven in reverse, the moving direction of the vehi- 
' cle being determined in response to the position of steered wheels (7a), the apparatus (10) comprising a camera 

(2^ for capturing an image of an area behind the vehicle (1) and a monitor (4) for displaying the image captured by 
the camera (2). characterized by a display control unit (1 1) for displaying a guide marking (20. 2i:^ /a, 2 /d) thai is 
fixed at a predetermined position with respect to the monitor screien (19) for aiding a driver in parking, the control 
unit (1 1) displaying the guide marking and the image simultaneously on the monrtor (4) when the vehicle moves in 
reverse, wherein the parallel parking is completed by causing the marking to coinciuc with a target point (26, E. E', 
E") in the image, followed by backing while keeping the steered wheels (7a) turned at their maximum angle. 

1 5 The apparatus as recited in claim 14, wherein the fixed marking includes a pair of side marks (20a) that are spaced 
apart approximately by the apparent width of the vehicle and a fixed end mark (20b) formed by connecting ends of 
the side marks (20a) on the screen (19). and wherein the fixed guide marking includes a center mark (21) posi- 
tioned at the center of the fixed guide marking. 

1 6 The apparatus as recited in daim 1 4, wherein the display includes a first marking {27a) used when performing par- 
allet parking to the left and a second marking (27b) used when performing parallel parking to the right. 

17. The apparatus as recited in claim 16. wherein the first marking (27a) and the second marking (27b) are selectively 
displayed depending on whether the vehicle (1) is to be parked to the left or to the right. 

1 8 The apparatus as recited in claim 1 4. wherein the vehicle has obstruction detectors (6) for detecting an obstruction 
existing near the front corners of the vehicle, and wherein the display control unit (1 1) displays the presence (22) 
of the obstruction on the monitor screen (19) on the basis of a signal output from the obstruction detectors (6). 
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